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REAL EIGENVALUES OF NONSYMMETRIC TENSORS 


JIAWANG NIE AND XINZHEN ZHANG 


Abstract. This paper discusses the computation of real Z-eigenvalues and 
H-eigenvalues of nonsymmetric tensors. A general nonsymmetric tensor has 
finitely many Z-eigenvalues, while there may be infinitely many ones for spe¬ 
cial tensors. In the contrast, every nonsymmetric tensor has finitely many 
H-eigenvalues. We propose Lasserre type semidefinite relaxation methods for 
computing such eigenvalues. For every nonsymmetric tensor that has finitely 
many real Z-eigenvalues, we can compute all of them; each of them can be 
computed by solving a finite sequence of semidefinite relaxations. For every 
nonsymmetric tensor, we can compute all its real H-eigenvalues; each of them 
can be computed by solving a finite sequence of semidefinite relaxations. Var¬ 
ious examples are demonstrated. 


1. Introduction 


For positive integers m and ,n m , an m-order and (ni,ri2) - '' i n m)- 

dimensional real tensor is an array in the space R n ixn 2 x---xn m _ Every tensor A 
from this space can be indexed as 


(1.1) A = 1 <ij < rij, j = 1,2,- ■■m. 

When n 1 = • • • = n m = n, A is called an m-order n-dimensional tensor. In such 
case, the tensor space R n ixra 2 X"-xn m j g d eno t e d as T m (R ra ). A tensor in T m (IR ra ) 
is said to be symmetric if its entries are invariant under permutations of indices 
(ii, * 2 ,..., i m ). The subspace of symmetric tensors in T m (M n ) is denoted as S m (K"). 
By replacing the real field R. by the complex field C, the tensor spaces T m (C") and 
S m (C”) are similarly defined. Using the notation as in Qi [29], for A £ T m (C") and 
x := (xi,..., x n ), we denote 


( 1 . 2 ) 


A rp'rri . — \ A . nr ■ nr ■ . . . nr • 

•xl'-C .— / j •‘•'Im 1 

l<«i ,••• ,i m <n 

Ax m ~ l ■.= ( £ A ji2 ... im x i2 ■ ■ • a 




Note that Ax m 1 is an n-dimensional vector. Now we give some definitions of 
tensor eigenvalues that are introduced in Wii. 


Definition 1.1. For A £ T m (C"), a number A £ C is called a Z-eigenvalue of A if 
there exists a vector u £ C n such that 

(1.3) Au m ~ 1 = Xu, u T u = 1. 
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(The superscript T denotes the transpose.) Such u is called a Z-eigenvector associ¬ 
ated with X, and such (A ,u) is called a Z-eigenpair. 

Definition 1.2. For A £ T m (C"), a number X £ C is called an R-eigenvalue of A 
if there exists 0 / C n such that 

(1.4) Au™- 1 = Xu [m ~ 1] . 

(The symbol denotes the vector such that = (itj) m_1 for i = 

1 Such u is called an Hi-eigenvector associated with X, and such (A ,u) 

is called an R-eigenpair. 


When A is a real Z-eigenvalue (resp., H-eigenvalue), the associated Z-eigenvector 
(resp., H-eigenvector) is not necessarily real. The (A, it) is called a real Z-eigenpair 
(resp., H-eigenpair) if both A and u are real. In the paper, we only discuss real 
eigenvalues. Throughout the paper, for convenience, we call A a real Z-eigenvalue 
(resp., H-eigenvalue) if both X and u are real. 

Tensor eigenvalues have broad applications in sciences and engineering. They 
were introduced in Lim [16] and Qi [28 . The Z-eigenvalus and H-eigenvalues are 
useful in signal processing, control, and diffusion imaging (cf. |2 19, ;27) [30] f3li). 
For an introduction to the theory and applications of tensor computations, we refer 

to mmaiMi- 

When A is a real symmetric tensor, Cui et al. [3] discussed how to compute all 
real Z-eigenvalues and H-eigenvalues. There also exists work on computing partial 
eigenvalues, e.g., the biggest and smallest ones. For the case ( m,n ) = (3,2), Qi et 
al. [33] discussed how to compute largest Z-eigenvalues. Shifted power methods are 
proposed for computing largest Z-eigenvalues (cf. OSS]). In [20], a semidefinite 
relaxation method was proposed to find best rank-1 approximations, which can also 
be used for computing largest Z-eigenvalues. As shown in [9:, !35], it is NP-hard to 
compute extreme eigenvalues of tensors. For nonnegative tensors, the largest H- 
eigenvalues can be computed by methods based on the Perron-Frobenius theorem 
(cf. [4] [25]). 

When A is a general nonsymmetric tensor, there is little work on computing 
all real Z-eigenvalues and H-eigenvalues. An elementary approach for this task is 
to solve the polynomial systems m and o directly, for getting all complex 
solutions by classical symbolic methods. This approach is typically quite expensive 
and not practical, because of typically high complexity of symbolic computations. 

There are fundamental differences between symmetric and nonsymmetric tensor 
eigenvalues. It is known that every symmetric tensor has finitely many Z-eigenvalues 
(cf. 0). However, this may not be true for nonsymmetric tensors. A nonsymmetric 
tensor may have no real Z-eigenvalues, or may have infinitely many real ones. We 
show such facts by the following examples. 

Example 1.3. Consider the tensor A £ T 4 (R 2 ) such that Aijki = 0 except 
Ahi 2 = A 1222 = 1, A 2111 = A 2122 = —1- 
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By the definition, (A,x) is a Z-eigenpair if and only if 


( x\ + x\)x 2 = Axi, 

— (x? + x|)xi = Ax 2 , 
x? + X2 = 1 . 


One can check that the above does not have a real solution, so A has no real Z- 
eigenpairs. By the definition, (A,x) is an R-eigenpair if and only if 


(x? + x|)x 2 = Ax?, 

— (x? + x 2 )xi = Ax?, 
(xi,x 2 ) ^ (0,0). 


One can similarly check that A has no real R-eigenpairs. 

Example 1.4. Consider the tensor A £ T 4 (R 2 ) such that Aijki = 0 except 


Alim = Al 2 n 2 = 1. 

Then, (A,x) is a Z-eigenpair of A if and only if 



(1.5) 


One can check that every A £ [0,1] is a real Z-eigenvalue, with 4 real Z-eigenvectors 


(ii/A, ±\/l — A). 


However, we would like to remark that the above examples are not general cases. 
In fact, every generic nonsymmetric tensor has finitely many Z-eigenvalues, and its 
number can be given by explicit formula. This is shown by Cartwright and Sturmfels 
[5]. Moreover, every nonsymmetric tensor has finitely many H-eigenvalues. By these 
facts, it is generally a well-posed question to compute all real Z-eigenvalues and H- 
eigenvalues. 

In this paper, we propose numerical methods for computing all real Z-eigenvalues 
(if there are finitely many ones) and all H-eigenvalues. For symmetric tensors, the 
Z-eigenvalues and H-eigenvalues are critical values of some polynomial optimization 
problems. This property was significantly used in U for computing all real eigen¬ 
values. The method in [3] is based on Jacobian SDP relaxations [23], which are 
specially designed for solving polynomial optimization. Indeed, the same kind of 
method can be used to compute all local minima of polynomial optimization 124j . 
However, the method in [3] are not suitable for computing eigenvalues of nonsym¬ 
metric tensors, because their eigenvalues are no longer critical values of polynomial 
optimization problems. 

This paper is organized as follows. Section 2 gives some preliminaries on polyno¬ 
mial optimization and tensor eigenvalues. Section 3 proposes Lasserre type semidef- 
inite relaxations for computing real Z-eigenvalues. If there are finitely many ones, 
all the real Z-eigenvalues can be found, and each of them can be computed by solv¬ 
ing a finite sequence of semidefinite relaxations. Section 4 proposes Lasserre type 
semidehnite relaxations for computing all real H-eigenvalues. Each of them can 
be computed by solving a finite sequence of semidefinite relaxations. Numerical 
examples are shown in Section 5. 



4 


JIAWANG NIE AND XINZHEN ZHANG 


2. Preliminaries 


In this section, we review some basics in polynomial optimization. We refer to 
[H [15! for surveys in the area. In the space R”, the symbol || • || denotes the 
standard Euclidean norm. Let R[x] be the ring of polynomials with real coefficients 
and in variables x := (xi,..., x n ), and let R[x]d be the set of real polynomials in x 
whose degrees are at most d. For a polynomial tuple h = (hi, h. 2 ,■■ ■ . h s ). the ideal 
generated by h is the set 

1(h) ■.= h\ ■ R[x] + ft -2 • R[x] + ■■■ + h s ■ R[x]. 

The /c-th truncation of I ( h ) is the set 

h(h) ■= hi • R \x\k—deg(h,) + ' ' ' + h s ■ R[x]fc_ deg(h a )- 
The complex and real algebraic varieties of h are respectively defined as 
V c (h) := {ieP | h(x) = 0}, V*(h) := V c (h) n R n . 

A polynomial p is said to be sum of squares (SOS) if there exist pi,P 2 , ■ ■ -p r £ R[x] 
such that p = P 1 +P 2 + ■ ■ ■ +Pr- The set of all SOS polynomials is denoted as E[a;]. 
For a given degree m, denote 

E[x] m := E[a;] D R[z] m . 

The quadratic module generated by a polynomial tupe g = (g 1 , ■ • • ,gt) is the set 


Q(a) '■= S N + 91 ■ S N h-1- gt ■ SN- 


The k- th truncation of the quadratic module Q(g) is the set 

Qk(g) '■= E[x] 2 fc + gi ■ E [x] 2k—deg(gi ) H-+ 9t ’ ^\x\2k-deg(g t ) ■ 

Note that if g = 0 is an empty tuple, then Q(g) = E[x] and Qk(g) = E[x] 2 fc- 

Let N be the set of nonnegative integers. For x := (xi,..., x n ), a := (ai,..., a n ) 
and a degree d, denote 



|a| :=ar+ ••■ + «„, := {a e N n : \a\ < d}. 


Denote by R N 2 the space of all real vectors y that are indexed by a € N[J. For 
y € R Nd , we can write it as 


V = (da), a € N£. 


For / = /a 1 " € R[a:]d and y € R N ^, we define the operation 

( 2 . 1 ) 



For an integer t < d and y £ R Nd , denote the t-th truncation of y as 


( 2 . 2 ) 


y\t ■— (ya)a£Nt ■ 


Let q £ R[x] with deg(g) < 2k. For each y £ R N 2 fc, ( qp 2 , y) is a quadratic form in 
vec(p), the coefficient vector of the polynomial p with deg(<?p 2 ) < 2k. Let Lq k \y) 
be the symmetric matrix such that 

(2.3) 
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The matrix Lq k \y) is called the fc-th localizing matrix of q generated by y. It is 
linear in y. For instance, when n = 2, k = 2 and q = X\X 2 — xf — x|, 


( 2/n — 2/20 — 2/02 ?/2i — 2/30 — 2/12 2/12 — 2/21 — 2/03 \ 

2/21 - 2/30 - 2/12 2/31 - 2/40 - 2/22 2/22 - 2/31 - 2/13 

2/12 — 2/21 — 2/03 2/22 — 2/31 — 2/13 2/13 ~ 2/22 — 2/04 / 


If g = (gi,..., q r ) is a tuple of polynomials, we then define 
Lf\y) := (L^(y),...,L^(y)). 

When q = 1 (the constant 1 polynomial), L^ k \y) is called the k -th moment matrix 
generated by y , and we denote 

(2.4) M k (y) := L[ k \y). 

For instance, when n = 2 and k = 2, 


o 

o 

S* 

2/io 

2/oi 

2/20 

2/11 

2/02 ^ 

2/io 

2/20 

2/n 

2/30 

2/21 

2/12 

2/oi 

2/n 

2/02 

2/21 

2/12 

2/03 

2/20 

2/30 

2/21 

2/40 

2/31 

2/22 

2/u 

2/21 

2/12 

2/31 

2/22 

2/13 

\ 2/02 

2/12 

2/03 

2/22 

2/13 

2/04 / 


For a degree d, denote the monomial vector 

(2.5) [x] d := [1 xi ■■■ x n x\ xi_x 2 ■ ■ ■ x 2 n ■ ■ ■ xf ■ ■ • x™] T . 


As shown in Example ll.4l there may be infinitely many Z-eigenvalues. But this is 
not the case for a general nonsymmetric tensor. In m, a real Z-eigenpair (A, u) of 
a tensor A is called isolated if there exists e > 0 such that no other real Z-eigenpair 
(y.,v) satisfies |A — /i| + ||m — u|| < e. Similarly, areal Z-eigenvalue A is called isolated 
if there exists e > 0 such that no other real Z-eigenvalue y satisfies \A — y\ < e. In 
practice, we need to check whether a Z-eigenvalue or Z-eigenpair is isolated or not. 
Denote 


F(X,x) 


x T x — 1 
Ax m_1 — Ax 


Then, (A, it) is a Z-eigenpair of A if and only if F(A,w) = 0. Let J(A,x) be the 
Jacobian matrix of the vector function F( A,x) with respect to (A,x). 


Lemma 2.1. Let A £ T m (M") and A be a real Z-eigenvalue of A. 


(i) If u is a real Z-eigenvector associated with A and J(A,u) is nonsingular, 
then (A, u ) is isolated. 

(ii) If Mi,... ,un are the all real Z -eigenvectors of A associated to A and each 
J(A,Ui) is nonsingular, then A is an isolated Z-eigenvalue of A. 


Proof, (i) We prove it by a contradiction argument. Suppose otherwise the Z- 
eigenpair (A ,u) is not isolated. Then there exists a sequence {(A;,m^^)}^ 1 of Z- 
eigenpairs such that each (A i,u^) ^ (A ,u) and (A i,u^) —> (A ,u). Let 




A; - A 
— u 
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By the second order Taylor expansion, we have 

0 = F(X h u^) = F(X, u) + J(X,u)d® + 0(||d W || 2 ). 

Note that F(X,u ) = 0 and each ||d®|| ^ 0. The above implies that 

7(A,«)(dW/||dW||) =0(||dW||). 

Since each /\\d ^|| has unit length, we can generally assume that d^/\\d^ || — > d. 

Then ||d|| = 1 and d ^ 0. The above implies that 

J( A, u)d = 0, 

contradicting the nonsingularity of J(A,w). So, (A, it) is isolated. 

(ii) Suppose otherwise that A is not isolated. Then there exists a sequence {A;} 
of distinct real Z-eigenvalues such that A; —> X. Each A; has a real Z-eigenvector u®. 
Since has unit length, we can generally assume —> u. Thus, (A i,u^) —> 

(A ,u). Clearly, (A ,u) is also a real Z-eigenpair, but it is not isolated. By the 
assumption, u is one of iq,... ,un ■ So, one of (A, iq) is not isolated, which is a 
contradiction. □ 


3. Computing Z-eigenvalues 

Let A € T m (R ra ) be a tensor. Recall that (A, u) is a Z-eigenpair of A if Au m_1 = 
Xu and u T u = 1. So, 

A = A u T u = u T Au m ~ 1 = Au m . 

Hence, it is a Z-eigenvector if and only if 

Au m ~ 1 = ( Au m )u , u T u = 1, 

and the associated Z-eigenvalue is „4it m . A general nonsymmetric tensor in T m (K. ra ) 
has finitely many Z-eigenvalues, as shown in j5]. For special tensors, there might 
be infinitely many ones (cf. Example I l.dl) . 

In this section, we aim at computing all real Z-eigenvalues when there are finitely 
many ones. Let h the polynomial tuple: 

(3.1) h = (Ax m —i — ( Ax m )x , x T x — 1). 

Then, it is a Z-eigenvector of A if and only if h(u) = 0. Let Z(R, A) denote the set 
of real Z-eigenvalues of A. If it is a finite set, we list Z(K, A) monotonically as 

Ai < A 2 < • • • < Aat. 

We aim at computing them sequentially, from the smallest to the biggest. 

3.1. The smallest Z-eigenvalue. To compute the smallest Z-eigenvalue Ai, we 
consider the polynomial optimization problem 

(3.2) min f(x) := Ax m s.t. h(x) = 0, 

where h is as in (ED. Note that it is a Z-eigenvector if and only if h(u) = 0, with 
the Z-eigenvalue /(u). The optimal value of (13.21) is Ai, if it exists. Let 

(3.3) k 0 = [(to + l)/2]. 
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Lasserre’s hierarchy [13] of semidefinite relaxations for solving (13.21) is 
( f\' k ~ min (/, y) 

( 3 - 4 ) S S.t. {l,y) = 1, L^\y) = 0, 

l M k (y)hO,yeR N ^, 

for the orders k = ko,ko + l, _ See dn-dia for the notation L^\y) and Mk(y). 

In the above, X >z 0 means that the matrix X is positive semidefinite. The dual 
optimization problem of (13.41) is 

(o r.) { fi k ~ max 7 

\ s.t. f - 7 £ hk{h) + S[a;] 2 fc- 

As in HE it can be shown that for all k 

f 2,k < f l,k < Ai 

and the sequences {fl’ k } and {fi’ k } are monotonically increasing. 

Theorem 3.1. Let A £ T m (R") and Z(M.,A) be the set of its real Z- eigenvalues. 
Then we have: 


(i) The set Z(R, A) = % if and only if the semidefinite relaxation is 

infeasible for some order k. 

(ii) If Z(R, A) ^ 0 and Ai is the smallest Z-eigenvalue, then 

(3.6) lim fl' k = lim f\' k = Ai. 

k—too k—> oo 

If in addition, Z(M.,A) is a finite set, then for all k sufficiently big 

(3.7) fi' k = fl' k = An 

(iii) Suppose y* is a minimizer of \3.f | ). If there exists t < k such that 

(3.8) rank M t -k 0 (y*) = rank M t (y*), 

then fl’ k = Ai and there are r := rankAI t (y*) distinct real Z-eigenvectors 
Ui, ..., u r associated with Ai. 

(iv) Suppose Z(M., A) is a finite set. If there are finitely many real Z-eigenvectors 

associated with Ai, then, for all k big enough and for every minimizer y* 
of £OP is satisfied for some t < k. 


Proof, (i) “if’ direction: this is obvious. If A has a real Z-eigenpair (A ,u), then 
[u\ 2 k (see (12.51) for the notation) is feasible for (13.41) . a contradiction. 

“only if’ direction: If A has no real Z-eigenvalues, then the equation h(x ) = 0 
has no real solutions. By Positivstellensatz (cf. [I]), —1 £ 1(h) + S[x]. So, when k 
is big enough, —1 £ I 2 k(h) + T,[x] 2 k, and then (13.51) is unbounded from above. By 
weak duality, (13.41) must be infeasible, for all k big enough. 

(ii) Note that x T x — 1 is a polynomial in the tuple h. So, —(x T x — l) 2 £ 1(h) 
and the set —(x T x — l ) 2 > 0 is compact. The ideal 1(h) is archmedean (cf. jGJj)- 
The asymptotic convergence (13.61) can be implied by Theorem 4.2 of (13]. 

Next, we prove the finite convergence (13.71) when Z(KL, A) ^ 0 is a finite set. 
Write Z(K, A) = {Ai,..., A^v}, with Ai < ■ ■ • < \n- Let b\,... ,bw £ R[t] be the 
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univariate real polynomials in t such that bi(Xj) = 0 when i yb j and bi(Xj) = 1 
when i = j. For i = 1 ,,N, let 

Si~ {Xi-X 1 )(b i (f(x)^j . 

Let s := Si + ■ ■ ■ + Sjy. Then, s £ E[x] 2 k± for some k\ > 0. The polynomial 

f '■= f — X\ — s 

vanishes identically on Vr (h). By Real Nullstellensatz (cf. [1; Corollary 4.1.8]), 
there exist an integer £ > 0 and q £ E[a;] such that 

f 2t + q € 1(h). 

For all e > 0 and c > 0, we can write 

/ + e = 4> e + 0 E where 

cj) e = —ce 1-2 ^(/ 2 ^ + q), e e = e(l + f/e + c(//e) 2 ^ + ce 1 _ 2 E g. 

By Lemma 2.1 of m, when c > there exists k 2 such that, for all e > 0 , 

4*e £ hk 2 (h), £ E[x]2fc2- 

Hence, we can get 

/ - (Ai - e) = 4 + cr e , 

where cr e = 0 E + s £ E[a;] 2 fc 2 for all e > 0. This implies that, for all e > 0, 
7 = Ai — e is feasible in (13.51) for the order fc 2 - Thus, we get ff' k ' 2 > X±. Note that 
fi’ k < fi < Ai for all k and the sequence {fl' k } is monotonically increasing. So, 
(EH must be true when k > k 2 - 

(iii) Note that M t (y*) h 0 and L^\y*) = 0, because t < k. When (13.81) is 
satisfied, by Theorem 1.1 of |Bj, there exist r := rankM t (y*) vectors u\,...,u r £ 
Vr ih) such that 

y*\lt = Ci[Mi] 2t H-b C r [u r \ 2t, 

with numbers Ci,..., c r > 0. The condition (1, y*) = 1 implies that 

Cl + • • • + c r = 1 . 

By the notation (•, •) as in (12.11) . we can see that (/, [w^fc) = so 

fi’ k = = ci/(wi) H-b c r f(u r ), 

fi k < f(ui) i = 1 ,..., r, 
because each [u^k is feasible for EH- Thus, 

fi k = f(u l) = • • • = f(u r ). 

Also note that f\~ < Ai and each is a Z-eigenvector. So, 

fl' k = f(ui) = ■■■ = f(u r ) = Ai. 

(iv) When Z(K,A) is a finite set, the sequences {fl’ k } and {fi’ k } have finite 

convergence to Ai, by item (iii). If (13.21) has finitely many minimizers, i.e., Ai has 
finitely many real Z-eigenvectors, the rank condition (13.81) must be satisfied when 
k is sufficiently big. This can be implied by Theorem 2.6 of [22] . □ 
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Remark 3.2. (1) The rank condition (13.811 can be used as a criterion to check 
whether f^’ k = Ai or not. If it is satisfied, then we can get r distinct minimizers 
ui,... ,u r of GH, i-e., each Ui is Z-eigenvector of A. The vectors can be com¬ 
puted by the method in Henrion and Lasserre [7]. 

(2) Suppose (13.811 holds. If rank M k (y*) is maximum among the set of all optimizers 
of (13.411 . then we can get all mimizers of (13.211 (cf. [15] §6.6]), i.e., we can get all real 
Z-eigenvectors associated to Ai. When (13.4H - d3.5l) are solved by primal-dual interior 
point methods, typically we can get all Z-eigenvectors associated to Ai, if there are 
finitely many ones. 


3.2. Bigger Z-eigenvalues. Suppose the ith smallest real Z-eigenvalue A i is iso¬ 
lated and is known. We want to determine whether the next bigger one Ai+i exists 
or not. If it exists, we show how to compute it. Let S > 0 be a small number. 
Consider the polynomial optimization problem 


(3.9) 


J min f(x ) 

\ si. h[x) = 0, f(x) > A, + <5. 


Clearly, the optimal value of (13.911 is the smallest Z-eigenvalue that is greater than 
or equal to Ai + 6 . Let 


(3.10) w(Ai + S) := min{A e Z(NL, A) : A > Ai + 5}. 

Lasserre’s hierarchy of semidefinite relaxations for solving m is 


! nl,k 

Jill : = mm 
si. 

for the orders k = Icq, ko + 1 , 


if, y) 

(l,y} = l,4 fe) (y)=0, 

M k (y) h 0, Lf_ Xi _ s {y ) ^ 0 ,y £ 

... The dual problem of (13.1111 is 


(3.12) 


f 2,fc 

Jill : = max 

si. 


7 

/-ye I-2k{h) + Qk{f - K - S). 


Similar to Theorem IQ we have the following convergence result. 

Theorem 3.3. Let A £ T m (R") and Z(M.,A) be the set of real Z-eigenvalues of A. 
Suppose Ai e Z(R.,A). Then we have: 

(i) The intersection Z(R, A) D [Ai + <5, +oo) = 0 if and only if the semidefinite 
relaxation \3.11\) is infeasible for some order k. 

(ii) If Z(WL, A) D [Ai + S, + 00 ) ^ 0, then 

(3.13) lim /?/* = lim = w(A, + (5). 

k— yoo k—>o o 

If, in addition, Z{R,A) D [A, + <5, + 00 ) is a finite set, then 
(3-14) =^= 00 ^+ 6 ) 

for all k sufficiently big. 

(iii) Suppose y* is a minimizer of 1 ,9. 111) . If 13. <9|) is satisfied for some t < k, then 
fl+i = oj (Ai + S ) and there are r := rankM t {y*) distinct real Z-eigenvectors 
rti,..., u r , associated with the Z-eigenvalue u>(\i + S). 
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(iv) Suppose Z(M.,A) D [A, + 8, Too) is a finite set and u>(Xi T S) has finitely 
many Z-eigenvectors. Then, for all k big enough, and for every minimizer 
V* of US. Ill) , there exists t < k satisfying 

Proof. The proof is mostly same as for Theorem 13. II In the following, we only list 
the differences. 

(i) For the “only if’ direction: If Z(R,A) D [A* + 5, +oo) = 0, then (13.91) is 
infeasible. By Positivstellensatz, -1 g 1(h) T Q(f — A^ — <5). The resting proof is 
same as for Theorem 13.1 l ib 

(ii) The ideal 1(h) is archmedean, and so is 1(h) +Q(f — Xi — <5). The asymptotic 
convergence (13.131) can be implied by Theorem 4.2 of [15] , To prove the finite 
convergence (13.141) . we follow the same proof as for Theorem 13. If ni. Suppose 
Z(M., A) D [Aj T 6 , Too) = {v\, ..., vl}. Construct the polynomial s same as there 
and let 

f = f - <*>(Aj +<5) - s. 

Then / vanishes identically on the set {x £ K" : h(x) = 0 ,f(x) — A i — 8 > 0}. 
By Real Nullstellensatz (cf. [1] Corollary 4.1.8]), there exist an integer £ > 0 and 
q £ Q(f — A i — 6) such that f M T q £ 1(h). The resting proof is same, except 
replacing £[x] by Q(f - A- <5), and £[x] 2 fc by Q k (f - A* - 8). 

(iii) -(iv) The proof is same as for Theorem 13. lf iii)-(iv). □ 


The convergence of semidefinite relaxations of (13.11D - (13.12I) can be checked by the 
condition (13.81) . When it is satisfied, the Z-eigenvectors ui,...,u r can be computed 
by the method in [71. Typically, we can get all Z-eigenvectors if primal-dual interior- 
point methods are used to solve the semidefinite programs. We refer to Remark 13.21 

Next, we show how to use w(AjT<5) to determine Aj+i- Assume that Aj is isolated, 
otherwise there are infinitely many Z-eigenvalues and it is impossible to get all of 
them. If Xi is the biggest Z-eigenvalue, then we stop; otherwise, the next bigger 
one A l+ i exists. For such case, if S > 0 in m is small enough, then ui(Xi T 6) as 
in (13.101) equals Ai+i- Consider the optimization problem 

, , f Vi := max f(x) 

' ' ' \ s.t. h(x) = 0, f(x) < Xi + 5. 

The optimal value of (]3. 15D is the biggest Z-eigenvalue of A that is smaller than or 
equal to A i T (5, i.e., 

Vi = max{A £ Z(R, A) : X < Xi + <5}. 

The next bigger Z-eigenvalue A;+i can be determined by the following theorem. 

Theorem 3.4. Let A £ T m (R”) and 6 > 0. Suppose Xi is a Z-eigenvalue of A and 
Xmax is the biggest one. 

(i) Suppose Xi is an isolated Z-eigenvalue of A. If Vi = Xi and X ma x > Xi, then 
u>(Xi T 6) = Ai+i, which is the smallest Z-eigenvalue bigger than X j. 

(ii) If Vi = Xi and \3.11\) is infeasible for some k, then Xi = X max . 
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Proof, (i) We have seen that = Xi is the biggest Z-eigenvalue of A that is smaller 
than or equal to A i + 6. Since A i = Pi is isolated and A max > Ai, the smallest 
Z-eigenvalue bigger than \ is Aj+i, and A, + i > A, + S. By (13.101) . uj(Xi + S) is 
the smallest Z-eigenvalue that is greater than or equal to Xi + S. There are no 
Z-eigenvalues in the open interval (Ai, Ai+i). So, w(Ai + S) = Xi + 6. 

(ii) When (13.111) is infeasible for some k, by Theorem I3.3f i). all the real Z- 
eigenvalues are smaller than Xi + S. Note that Pi is the biggest Z-eigenvalue that is 
smaller than or equal to Ai + (5. If A i = Pi, then A i must be the biggest Z-eigenvalue, 
i.e., Xi — A max- n 


The problem (13.1511 is a polynomial optimization. Its optimal value v.-, can also 
be computed by solving Lasserre type semidefinite relaxations that are similar to 
(13. 1 1I) - (I3. 121) . When Ai is isolated, for <5 > 0 sufficiently small, we must have i \ = Xi, 
no matter if Ai+i exists or not. This is because Vi is the smallest Z-eigenvalue greater 
than or equal to A i + 5. Lemma l2Tl can be used to verify that Ai is isolated. 

3.3. An algorithm for computing all real Z-eigenvalues. Assume all the real 
Z-eigenvalues of the tensor A are isolated. We compute all of them, from the 
smallest to the biggest. First, we compute Ai if it exists, by solving m-m- 
After getting Ai, we solve the hierarchy of (13.1 ID - (13.12D and then determine A 2 . 
If A 2 does not exist, we stop; otherwise, we then determine A 3 . Repeating this 
procedure, we can get all the real Z-eigenvalues. 

The following algorithm can be applied to get Z-eigenvalues. 

Algorithm 3.5. Compute real Z-eigenvalues of a tensor A £ T m (R"). 

Step 0: Choose a small positive value for 6 (e.g., 0.05 ). 

Step 1: If j3.4\ ) is infeasible for some order k, then A has no real Z-eigenvalues and 
stop. Otherwise, solve it to get the smallest Z-eigenvalue Ai. Let i = 1. 

Step 2: Solve \3.15\) for Vi. If Vi = Xi, go to Step 3. Otherwise, reduce the value of 
S (e.g., let 6 := 5/5) and compute Pi. Repeat until we get Vi = Xi. 

Step 3: If 13. 1 1\) is infeasible for some order k, the largest Z-eigenvalue is Xi and 
stop. Otherwise, solve it for uj(5i + 6). Let A^+i := iv(6i + 6), i := i + 1 and 
go to Step 2. 

For a generic tensor A, it has finitely many Z-eigenvalues, and all of them are 
isolated. So, Algorithm 13.51 terminates after a finite number of steps, for almost all 
nonsymmetric tensors in T m (R ra ). 

4. Computing all H-eigenvalues 

In this section, we compute all H-eigenvalues for nonsymmetric tensors. Unlike 
Z-eigenvalues, the number of H-eigenvalues is always finite. 

Proposition 4.1. Every tensor A £ T m (C n ) hasn(m— l) n_1 complex H- eigenvalues, 
including their multiplicities. 
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Proof. Let I £ T m (R") be the identity tensor whose only non-zero entries are 
Xu-.-i = 1, with i = 1,2, • • • ,n. Recall that A is an H-eigenvalue if and only if there 
exists 0 / « £ C" such that Alu m_1 = that is, (A — A X)u m ~ 1 = 0. By 

the definition of resultant (cf. [34]), which we denote by Res, A is an H-eigenvalue 
if and only if 

(4.1) Res((A - XX)x m ~ 1 ) = 0. 

The resultant Res{(A — XZ)x m ~ 1 ) is homogeneous in the entries of A and A. It 
has degree D := n(m — l) n_1 . We can expand it as 

Res((A - AI)x m_1 ) = po(A) +pi(Al)A -|- Vpd{A)X d . 

By the homogeneity of Res, pd{A) = Res(—Xx m ~ 1 ) ^ 0, because the homogeneous 
polynomial system —Ix m ~ 1 = 0 has no nonzero complex solutions. This means that 
Res((A— XX)x m ~ 1 ) is not constantly zero, and its degree is D. Therefore, (14.11) has 
D complex roots including multiplicities. Hence, A has D complex H-eigenvalues. 
□ 


Recall that (A ,u) is a real H-eigenpair of a tensor A £ T m (K™) if and only if 
0 ^ u £ M™ and Au" 1-1 = Let m o be the biggest even number not bigger 

than w, i.e., 

Too = 2 [(to — 1)/2~|. 

Note that m — 1 < Too < to. We can normalize such u as 

(4.2) -I-+ {u n ) m ° = L 

Under this normalization, the H-eigenvalue A can be given as 

A = A(M [mo “ m+ 11 ) T u [m - 11 = (u [m °- m+1] ) T Au™- 1 . 

Let h be the polynomial tuple 

n 

(4.3) h := ( Ax m ~ 1 - ((x^ mo - m+1] ) T Ax m - 1 )x lm - 1 \J^(x i ) mo - l). 

i=l 

Then, u is an H-eigenvector normalized as in (14.21) if and only if hfu) = 0. Since A 
has finitely many H-eigenvalues, we can order its real ones monotonically as 

Hi < H2 <■■■ < PN, 

if at least one real H-eigenvalue exists. We call /ii the ith smallest H-eigenvalue. 


4.1. The smallest H-eigenvalue. In this subsection, we show how to determine 
pi. Let h be the polynomial tuple as in (14.31) . then pi equals the optimal value of 
the optimization problem 

min /( x) := (x^ mo ~ m+1 ^) T Ax" 1-1 
s.t. h(x) = 0. 

of semidefmite relaxations for solving (14.41) is 


(4.4) 

Lasserre’s hierarchy 


(4.5) 


p\ k := min {f,z) 


s.t. {l,z) = 1, L {k) (z) = 0, 
M k (z) z£ M N ^, 
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for the orders k = ko , ko + 1 ,..., where 

(4.6) k 0 := [(to 0 + m - l)/2]. 

The dual optimization problem of (14.51) is 


(4 7) ( Pi k ■= max 7 

\ s.t. f - 7 G hk(h) + S[T] 2 fc. 

As can be shown in na, Pi' k < Pi’ fc < /^i for all k, and the sequences {p\' k } and 
{p\' k } are monotonically increasing. 


Theorem 4.2. Let A € T m (R”) and ff(R, A) be the set of its real H- eigenvalues. 
Then we have: 


(i) The set H (R, A) = 0 if and only if the semidefinite relaxation B is 
infeasible for some order k. 

(ii) If H(WL, A) 0, then for all k sufficiently large 



1 ,k 2 ,k 
Pi =Pi = Pi- 


Let ko be as in (Tty - Suppose z* is a minimizer of If there exists an 

integer t < k such that 


(4.9) rank M t _k 0 (z*) = rank M t (z*), 

then p\' k = pi and there are r := rankMfz*) distinct real U-eigenvectors 
Ui,... ,u r associated with pi and normalized as in | f.2\ ). 

(iv) Suppose A has finitely many H -eigenvectors associated to p\. Then, for all 
k big enough and for every minimizer z* of U-A) , there exists an integer 
t < k satisfying (O- 


Proof. It can be proved in the same way as for Theorem 13.II The only difference is 
that H(M.,A) is always a finite set, by Proposition l4.ll For cleanness of the paper, 
we omit the proof here. □ 


The rank condition (14.91) is a criterion for checking the convergence of Lasserre’s 
hierarchy of (H31) and (TOT) . When it is satisfied, the H-eigenvectors u\,...,u r 
can be computed by the method in [7]. Typically, we can get all H-eigenvectors if 
primal-dual interior-point methods are used to solve the semidefinite relaxations. 
We refer to Remark l3.2l 


4.2. Bigger H-eigenvalues. Suppose the ith smallest real H-eigenvalue pi exists 
and is known. We want to determine whether the next bigger one pi+i exists or 
not. If it exists, we show how to compute it. 


(4.10) 


Let <5 > 0 be a small number. Consider the optimization problem 
J min f(x) 

\ s.t. h(x) = 0 , f(x) > pi+ 5, 

where /, h are same as in (14.41) . The optimal value of (14.101) is the smallest H- 
eigenvalue of A that is greater than or equal to pi + 6. Denote 

(4.11) vu(pi + S) := min{^( £ H(R, A) : p> Pi + (5}. 
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Lasserre’s hierarchy of semidefinite relaxations for solving (14.1011 is 


f p]^ := min 
(4.12) l s.t. 

for the orders k = ko,ko + 1, 


(/> z ) 

(l,z) = l,L ( il k \z) = 0, 

Mk(z ) h 0, Lfl^z) h0,z£ 

... The dual problem of (14.1211 is 


(4.13) 


f P-+i := max 7 

\ s.t. f -7 G I 2 k(h) + +Qk(f ~ IM~ 5). 


The properties of relaxations (I4.12ll - (I4.13I1 are as follows. 


Theorem 4.3. Let A £ T m (R n ) and H(M.,A) be the set of its real H- eigenvalues. 
Assume that pi £ H(R,A). Then we have: 


(i) The intersection H( R, .4) fl [pi + 6 , + 00 ) = 0 if and only if the semidefinite 
relaxation jf-12f ) is infeasible for some order k. 

(ii) If H (R, A) D [pi + S, + 00 ) f 0, then for all k sufficiently large 

(4.14) p-+i = p-+i = ™(pi + S). 

(iii) Let z* be a minimizer of \^.12\) . If | f.9\ ) is satisfied for some t < k, then 
there exists r := rankMfiz*) E-eigenvectors u±,... ,u r that are normalized 
as in U-“2\ ) and are associated with vj(pi +<5). 

(iv) Suppose A has finitely many E-eigenvectors that are associated with vu(pi + 

S) and are normalized as in (£f. Then, for all k big enough and for all 
minimizer z* of there exists t < k satisfying 1 4-9\). 


Proof. It can proved in the same way as for Theorem 13.31 Note that H (R, .4) is 
always a finite set, by Proposition 14. II □ 


In the following, we show how to use m(pi + S) to determine Pi+\ ■ Consider the 
maximization problem 

(a 1 7, / v i : = max f ( x ) 

' | s.t. h(x) = 0, f(x) < pi + 6. 

The optimal value of (14.151) is the biggest H-eigenvalue of A that is smaller than or 
equal to pi + 5, i.e., 

Vi = max{/i £ It(R,A) : p < pi + <5}. 

The next bigger H-eigenvalue Pi+i can be determined by the following theorem. 

Theorem 4.4. Let A £ T m (R") and 6 > 0. Suppose pi £ H( R, .4) and p ma x is 
the maximum E-eigenvalue. Let w{\i + S) be as in d^.ll[ ). 

(i) If Vi = pi and p m a X > pi, then i + S) = p i+1 . 

(ii) If Vi = pi and is infeasible for some k, then pi = p m ax- 


Proof. The proof is same as for Theorem 13.41 Note that A has finitely many H- 
eigenvalues, and pi is always an isolated one. □ 
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Since (14.1511 is a polynomial optimization, the optimal value Vi can also be com¬ 
puted by solving Lasserre type semidefinite relaxations that are similar to (14.1211 - 
(I4.13D . For S > 0 sufficiently small, we must have ty = no matter if Hi+i exists 
or not. This is because v, is the biggest H-eigenvalue that is less than or equal to 
Hi + 5. 

4.3. An algorithm for all H-eigenvalues. We can compute all real H-eigenvalues 
of a tensor A sequentially, from the smallest one to the biggest one, if they exist. 
A similar version of Algorithm 13.51 can be applied. 

Algorithm 4.5. Compute all real H- eigenvalues of a tenosr A £ T m (R"). 

Step 0: Choose a small positive value for 6 (e.g., 0.05 ). 

Step 1: If is infeasible for some order k, then A has no real H- eigenvalues and 
stop. Otherwise, compute the smallest one Hi by solving the hierarchy of 
jf.5\) . Let i := 1. 

Step 2: Solve J 4-15\ ) for its optimal value Vi. If Vi = Hi> 9° t° Step 3; otherwise, 
reduce S (e.g., 6 = 6/5) and compute Uj. Repeat until we get Vi = Hi- 
Step 3: If H4-12\ ) is infeasible for some order k, the largest H- eigenvalue is Hi an d 
stop. Otherwise, compute vo(Hi + 6) by solving the hierarchy of \f. 12\ ). Let 
Hi+i '■= vo(Hi + 6), i := i + 1 and go to Step 2. 


5. Numerical Examples 

In this section, we give numerical examples for how to compute real Z-eigenvalues 
and H-eigenvalues for nonsymmetric tensors. The computation is implemented in 
MATLAB 7.10 in a Dell Linux Desktop with 8 GB memory and Intel(R) CPU 
2.8GHz. The software Gloptipoly 3 f 8 ] is used to solve the semidefinite relaxations. 
For computational results, only four decimal digits are displayed, for cleanness of 
the presentation. 

For odd ordered tensors, the Z-eigenvalues always appear in ± pairs, so only 
nonnegative Z-eigenvalues are shown for them. For Algorithm 13.51 to compute all 
of them, the real Z-eigenvalues of the tensor need to be all isolated. General non¬ 
symmetric tensors have finitely many Z-eigenvalues, so they are all isolated. In 
applications, for particular tensors, Lemma 12.11 can be used to verify that all real 
Z-eigenvalues are isolated, once they are computed. In all our examples, we used it 
to check the isolatedness. The computations of all real eigenvalues in our examples 
took from a few to a couple of seconds. 

Example 5.1. 7 |T?1 Example 3],) Consider the tensor A £ T 4 (R 2 ) with entries 
Ai 1 i 2 i$i 4 — 0 except 

-4iin = 25.1, A 1212 = 25.6, A 2121 = 24.8, A 2222 = 23. 

Applying Alaorith,ms \3.5\ and \f.5\ we get all the real Z-eigenvalues and H -eigenvalues 
correctly. The computed eigenvalues, as well as their eigenvectors, are shown in 
Table [7J 














16 


JIAWANG NIE AND XINZHEN ZHANG 


Table 1. Z/H-eigenpairs of the tensor in Example 5.1 


i 

1 

2 

3 

Z-eigenvalue A* 

23.000 

25.1000 


Z- eigenvectors 

±( 0 , 1 ) 

±( 1 , 0 ) 


E-eigenvalue pi 

23.0000 

25.1000 

49.2687 

E-eigenvector 

±( 0 , 1 ) 

±( 1 , 0 ) 

±(0.8527, ±0.8285) 


Table 2. Z/H-eigenvalues of the tensor in Example 15.41 


n 

Z-eigenvalues (> 0) 

E-eigenvalues 

n = 2 

10.5518 

none 

n = 3 

0.2336, 1.6614, 10.5063 

-2.5615, 0.3456 

n = 4 

3.3651, 8.8507, 10.4981 

-6.2888, -0.7048, 2.8947, 5.9245 


Example 5.2. 7 [32l Example 1]J Consider the tensor A G T 3 (R 3 ) with the entries 
A ili2 i 3 = 0 except 


Am = 0.4333, 
A 2S i = 0.5598, 
A 122 = 0.8087, 
^312 = 0.6708, 
-4i 33 = 0.3151, 
-4323 = 0.7726, 


"4i2i = 0.4278, 
.4311 = 0.0643, 
"4i32 = 0.20 73, 
"4322 = 0.8296, 
"4 213 = 0.1355, 
"4 333 = 0.5526. 


"4i3i = 0.4140, 
"4 321 = 0.38 15, 
"4 2 i2 = 0.7641, 
-4332 = 0.125, 
-4 2 23 = 0.7727, 


"4 211 = 0.8154, 
"4331 = 0.88 34, 
"4 2 22 = 0.99 24, 
"4h3 = 0.3871, 
"4 2 33 = 0.4089, 


"4 2 2i = 0.0199, 
"4 h 2 = 0.4866, 
.4232 = 0.8752, 
-4i23 = 0.0769, 
-4 3 i 3 = 0.9715, 


By Alaorithms \3.5\ and \4-5\ we get all its nonnegative Z-eigenvalues 

0.2331, 0.4869, 2.7418, 


and all its real H -eigenvalues 


1.3586, 1.4985, 1.5226, 4.7303. 

(1101 §4.1],) Consider the tensor A G T 3 (R 3 ) with A 


Example 5.3. 

Am = 0.0072, 
"42 31 = 0.5901, 
A122 — 0.0940, 
"4 312 = 0.5901, 

"4i33 = -0.1012, 
"4 3 23 = 0.2229, 


"4i2i = -0.4413, 
Am = 0.1941, 
"4 i 3 2 = —0.4099, 
A322 = 0.2950, 
A213 — —0.4099, 
.4333 = —0.4891. 


A131 — 0.1941, 
A321 — —0.4099, 
A212 — 0.0940, 
A 33 2 = 0.2229, 
"4 2 23 = 0.2950, 


A211 = -0.4413, 
"4331 = - 0 . 1012 , 
"4 2 22 = 0.2183, 
A113 = 0.1941, 
-4233 — 0.2229, 


ni 2*3 = 0 except 

-4221 — 0.0940, 
A112 = -0.4413, 
A232 = 0.2950, 
A123 = 0.5901, 
.4313 = - 0 . 1012 , 


By Alaorithms \3.5\ and \4-5\ we get all its nonnegative Z-eigenvalues 

0.0000, 0.5774 


and all its real H -eigenvalues 


0.0000, 0.7875. 


Example 5.4. 7 |20l Example 3.19],) Consider the tensor A G T 3 (R") such that 


- 4 ji 22 *3 — tan 




Applying Alaorithms \3.5\ and \4-5\ we get all the real Z-eigenvalues andE-eigenvalues. 
They are reported in Tabled for n = 2,3,4. There are no real H- eigenvalues for 
the case n = 2. 
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Table 3. Z/H-eigenvalues of the tensor in Example 15.71 


n 

Z -eigenvalues(> 0) 

H -eigenvalues 

2 

0.4721 

0.5138, 1.2654 

3 

0.6158 

0.5196, 2.0800, 2.2995, 2.4335 

4 

0.7682 

0.5199, 2.0964, 2.2980, 2.3991, 2.9454, 4.4609, 
4.9588, 5.4419 

5 

0.8384 

0.5199, 2.0978, 2.2997, 2.3860, 2.4010, 2.9658, 
4.4713, 4.4902, 4.6880, 4.7008, 5.0136, 5.7891, 
6.0668, 7.3250, 7.3469, 8.8555 


Example 5.5. Consider the tensor A £ T 4 (R 3 ) such that 

Ai x ...i 4 = arctan(i\i\i\i 4 ). 

By Alaorithms \3.5\ and \4-5\ we get all its real Z-eigenvalues 

-0.2700, 0.0003, 13.8286, 

and all its H- eigenvalues 

-0.3662, 0.0005, 41.4705. 

Example 5.6. Consider the tensor A £ T 4 (R 3 ) such that 

Ai-i 4 = (1 + i\ + 2 z 2 + 3z 3 + 4 * 4 ) 1 . 
By Alaorithms \3.5\ and\4-5\ we get all its real Z-eigenvalues 


0 . 0000 , 

0.0002, 

0.4572, 

and all its real H- eigenvalues 



0 . 0000 , 

0.0005, 

1.3581. 

Example 5.7. Consider the tensor A £ T 5 (R n ) such that 


lex P(*l)) ■ 

7=1 

For n = 2,3,4, 5, all the real Z-eigenvalues and H-eigenvalues are found by Algo- 
rithms fX5l and \J75\ They are shown in Tabled 

Example 5.8. Consider the tensor A £ T 3 (K") such that 

”40*2*3 = ^*1 + 2z 2 + 3z s — \Ji\ + 2i\ + 3. 

For the values n = 2,3,4, we get all the real Z-eigenvalues and H- eigenvalues, by 
Alaorithms\3. 5\ and\f.5\ They are reported in Tabled 
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Table 4. Z/H-eigenvalues of the tensor in Example 15.81 


n 

Z - eigenvalues (> 0) 

H -eigenvalues 

2 

0.0024, 0.0038, 1.4928 

0.0060, 2.0960 

3 

0.0067, 0.0161, 3.6417 

-0.0401, -0.0243, 0.0086, 0.0235, 0.1568, 

0.6635, 1.4958, 6.2378 

4 

0.0000, 0.0107, 0.0396, 6.9922 

-0.0240, -0.0087, 0.0000, 0.0102, 0.0258, 
0.0437, 1.5761, 2.6824, 4.1089, 5.8270, 13.7960 
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